Telegram Group & Telegram Channel
πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub



tg-me.com/machinelearning_interview/1792
Create:
Last Update:

πŸ¦™ ΠœΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Π°Ρ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° Π² llama.cpp (ΠΎΠ±Π½ΠΎΠ²Π»Π΅Π½ΠΈΠ΅)

llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ с Π²ΠΈΠ·ΡƒΠ°Π»ΡŒΠ½Ρ‹ΠΌ Π²Π²ΠΎΠ΄ΠΎΠΌ!

πŸ“¦ Π§Ρ‚ΠΎ Π½ΠΎΠ²ΠΎΠ³ΠΎ

ΠŸΡ€ΠΎΠ΅ΠΊΡ‚ llama.cpp Ρ‚Π΅ΠΏΠ΅Ρ€ΡŒ ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΈΠ²Π°Π΅Ρ‚ *ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½Ρ‹Π΅ ΠΌΠΎΠ΄Π΅Π»ΠΈ* β€” Ρ‚Π°ΠΊΠΈΠ΅ ΠΊΠ°ΠΊ LLaVA 1.5 / 1.6, BakLLaVA, Obsidian, MobileVLM ΠΈ Π΄Ρ€ΡƒΠ³ΠΈΠ΅, позволяя Π²Ρ‹ΠΏΠΎΠ»Π½ΡΡ‚ΡŒ Π²Ρ‹Π²ΠΎΠ΄, ΡΠΎΠ²ΠΌΠ΅Ρ‰Π°ΡŽΡ‰ΠΈΠΉ тСкст ΠΈ изобраТСния локально, Π±Π΅Π· ΠΎΠ±Π»Π°ΠΊΠ°.

πŸ”§ ΠšΠ»ΡŽΡ‡Π΅Π²Ρ‹Π΅ возмоТности

β€’ ΠŸΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ с Π²Π²ΠΎΠ΄ΠΎΠΌ изобраТСния (image + text)
β€’ Новый CLI: llama-mtmd-cli (замСняСт `llava-cli`)
β€’ Π Π°ΡΡˆΠΈΡ€Π΅Π½Π° ΡΠΎΠ²ΠΌΠ΅ΡΡ‚ΠΈΠΌΠΎΡΡ‚ΡŒ: ΠΏΠΎΠ΄Π΄Π΅Ρ€ΠΆΠΊΠ° GGUF-ΠΌΠΎΠ΄Π΅Π»Π΅ΠΉ ΠΌΡƒΠ»ΡŒΡ‚ΠΈΠΌΠΎΠ΄Π°Π»ΡŒΠ½ΠΎΠ³ΠΎ Ρ‚ΠΈΠΏΠ°
β€’ Π›ΠΎΠΊΠ°Π»ΡŒΠ½Π°Ρ Ρ€Π°Π±ΠΎΡ‚Π° Π½Π° CPU ΠΈ GPU Π±Π΅Π· зависимости ΠΎΡ‚ ΠΎΠ±Π»Π°Ρ‡Π½Ρ‹Ρ… API

πŸš€ Как ΠΈΡΠΏΠΎΠ»ΡŒΠ·ΠΎΠ²Π°Ρ‚ΡŒ

1. Π‘ΠΊΠ°Ρ‡Π°ΠΉ модСль Π² Ρ„ΠΎΡ€ΠΌΠ°Ρ‚Π΅ .gguf, Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€ LLaVA:
https://huggingface.co/liuhaotian/llava-v1.5-13b-GGUF
2. ΠŸΠΎΠ΄Π³ΠΎΡ‚ΠΎΠ²ΡŒ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΈΠ΅ (Π½Π°ΠΏΡ€ΠΈΠΌΠ΅Ρ€, `photo.jpg`)
3. Запусти CLI:


./build/bin/llama-mtmd-cli \
-m models/llava-v1.5-13b.gguf \
--image ./photo.jpg \
-p "Π§Ρ‚ΠΎ ΠΈΠ·ΠΎΠ±Ρ€Π°ΠΆΠ΅Π½ΠΎ Π½Π° Ρ„ΠΎΡ‚ΠΎ?"


β–ͺ GitHub

BY Machine learning Interview




Share with your friend now:
tg-me.com/machinelearning_interview/1792

View MORE
Open in Telegram


Machine learning Interview Telegram | DID YOU KNOW?

Date: |

If riding a bucking bronco is your idea of fun, you’re going to love what the stock market has in store. Consider this past week’s ride a preview.The week’s action didn’t look like much, if you didn’t know better. The Dow Jones Industrial Average rose 213.12 points or 0.6%, while the S&P 500 advanced 0.5%, and the Nasdaq Composite ended little changed.

The SSE was the first modern stock exchange to open in China, with trading commencing in 1990. It has now grown to become the largest stock exchange in Asia and the third-largest in the world by market capitalization, which stood at RMB 50.6 trillion (US$7.8 trillion) as of September 2021. Stocks (both A-shares and B-shares), bonds, funds, and derivatives are traded on the exchange. The SEE has two trading boards, the Main Board and the Science and Technology Innovation Board, the latter more commonly known as the STAR Market. The Main Board mainly hosts large, well-established Chinese companies and lists both A-shares and B-shares.

Machine learning Interview from hk


Telegram Machine learning Interview
FROM USA